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Conference  ipuitwmi  by  Air  Kurce  Oilier  of  Sricntilh  Urwrurdi 


<•«  ant  Sttakr  t  - 


Mi 


The  workshop  “Stochastic  Systems  and  Their  Applications"  was  held  in 
Newport  Hi  on  April  15  k'.  Hi  of  1994.  The  main  topics  of  the  conference  were 
asymptotic  methods  in  stochastic  systems  theory,  and  related  applications. 
The  goal  of  the  conference  was  to  review  recent  advances  in  asymptotic  meth¬ 
ods  and  ex|x»M'  some  mi|H>rtant  new  application  areas  where  tlu'se  methods 
might  l*e  useful. 

I,«w  li  da>  was  divider!  into  two  parts,  in  the  morning  talks  of  a  more 
theoretical  nature  vote  given,  while  the  afternoon  was  devoted  to  applica 
t ions .  1  he  main  application  areas  discussed  were  from  tommunications  and 
manufai  luring 

On  the  more  theoretical  side  there  were  talks  by  T  (i.  Kurtz  and  A.  13. 
\\<-nt/ell  on  approximations  via  stochastic  averaging  and  asymptotic  expan¬ 
sions  o|  him  Donats  of  Markov  processes,  respectively.  M  Zakai  spoke  on 
emu  bounds  in  nonlinear  liltermg,  while  R.  Khasmiuskn  reported  new  work 
on  methods  of  stabilizing  solutions  to  stochastic  differential  equations. 

1  he  talks  by  1.  karatzas.  M.  Reiman  and  L  Ljung  were  of  a  more  applied 
nature  Karal/as  described  recent  work  on  dynamic  allocation  when  the 
pioldein  had  been  formulated  as  a  bandit  problem.  Reiman  discussed  various 
heavy  traffic  limits  for  Markov-modulated  queues,  which  are  the  sort  that  ap- 
l»ear  in  «  urreut  models  of  digital  communication  networks,  while  Ljung  gave 
a  general  talk  on  recent  work  on  the  tracking  ability  of  adaptive  algorithms. 

1  In*  conference  was  rounded  out  by  two  talks  on  applications  that  are 
<  u neatly  of  great  interest.  1).  Mitra  discussed  asymptotic  methods  in  the 
analysis,  design,  and  contra!  of  high-speed  communication  networks.  P.  R. 
Kumar  considered  approximation  methods  for  queueing  systems.  The  high¬ 
light  of  his  talk  was  a  new  method  for  controlling  re-entrant  line  queues,  and 
an  application  of  the  methods  to  semi-conductor  manufacturing. 
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ABSTRACTS 


Torn  Kurtz 

Department  of  Mathematics 
University  of  Wisconsin 
480  Lincoln  Dr. 

Madison,  WI  53706 

Averaging  stochastically  perturbed  Hamiltonian  systems 

A  classical  problem  in  the  study  of  mechanical  systems  is  concerned  with 
the  behavior  of  such  systems  in  the  presence  of  nearly  rigid  constraints.  A 
system  of  this  type  can  be  modeled  as  follows.  Let  U,W  £  C2(iRd).  Assume 
that  \V  >  0  and  that  M  =  {x  (E  Uid  :  VF(x)  =  0}  is  an  m-dimensional 
manifold  with  m  <  d.  The  model  is  then  given  by  the  Hamiltonian  system 
Xn  =  —VU(Xn)  -  n V W ( A'„ )  where  the  parameter  n  is  assumed  to  be  large 
and  represents  the  strength  of  the  nearly  rigid  constraint.  The  main  problem 
is  to  characterize  the  limit  of  A',,  as  n  — ►  oo.  We  consider  the  more  general 
model  dXn  =  dqn  —  nVlf(X„)  where  {?/„}  is  a  sequence  of  semi  martingales. 
For  example,  r/n  might  be  given  by  di)n  —  a(Xn)dW  -  VU(Xn)dt  where  W 
is  standard  Brownian  motion.  The  classical  limit  results  are  extended  to  the 
stochastic  setting  and  ways  of  exploiting  the  stocliasticity  to  avoid  some  of 
the  uonuniquencss  problems  of  the  deterministic  setting  are  explored. 


Alexander  D.  Wentzell 
Department  of  Mathematics 

rrv.  _  l _ it.,.'. _ !i_. 

luiane  university 

New  Orleans,  LA  70118 

Asymptotic  expansions  in  limit  theorems  for  stochastic  processes 

For  some  families  of  stochastic  processes  ,  0  <  <  <  T,  one  can  prove 
limit  theorems  oil  weak  convergence: 

/•;/•’(  i, ‘(o,7i)  =  /;f(v°[o,  r\)  +  o(i) 


as  e  j  0  for  all  bounded  continuous  functionals  F.  One  can  try  to  find 
asymptotic  expansions  for  o(l)  for  some  narrower  classes  of  functionals: 

EFW[0,  T})  =  EF{rf[ 0, 71])  +  k{t)Cx  +  . . .  +  k(e)mCm  +  o(k(  t)m), 

where  k(e)  — ►  0  (c  |  0).  Some  theorems  of  this  kind  have  been  obtained,  and 
in  them  the  coefficients  C,  are  expressed  in  the  form 

C,  =  A%EF(VQ[0,T}), 

where  A,  are  linear  operators  acting  on  functionals  that  arc  expressed  in 
terms  of  characteristics  of  the  stochastic  processes  f/‘;  in  some  natural  classes 
of  cases,  infinite-dimensional  differential  operators. 

Possible  applications  to  Monte-Carlo  computation  are  described. 


Debasis  Mitra 
AT&T  Bell  Laboratories 
MH-2C-125 

Murrary  Hill,  NJ  07974 

Some  recent  directions  in  the  analysis  of  high-speed 
communication  networks 

The  talk  will  review  recent  results  on  (i)  stochastic  fluid  models  for  burst 
scale  effects  in  ATM,  (ii)  loss  and  service  priority  systems,  (iii)  admission  con¬ 
trol  and,  time  permitting,  (iv)  feedback-based  adaptive  allocation  of  band¬ 
width. 


Martin  L  R  ;iman 

AT&T  Bell  Laboratories,  RM  2C-117 

600  Mountain  Ave. 

Murray,  NJ  07974 

Some  observations  on  scaling  for  Markov  modulated  queues  in 

heavy  traffic 


<1 


Queues  with  Markov  modulated  input,  where  the  arrival  rate  depends 
on  the  state  of  a  “background”  Markov  process,  are  of  practical  interest  in 
communications  systems,  where  the  state  of  the  background  Markov  process 
is  the  number  of  active  sources.  The  most  common  input  process  models  in 
this  context  (given  the  state  of  the  background  process)  are  a  deterministic 
“fluid”  or  a  Poisson  process.  Although  much  has  been  done  in  the  area  of 
obtaining  efficient  numerical  solutions  for  these  models,  there  is  still  an  in¬ 
terest  in  asymptotics.  One  particular  asymptotic  regime  that  has  received  a 
lot  of  attention  is  heavy  traffic,  where  the  average  arrival  rate  is  close  to  the 
service  rate.  Since  there  are  many  parameters  in  this  model,  there  are  many 
ways  to  achieve  heavy  traffic.  Foi  example,  the  number  of  “sources”  can 
remain  fixed  or  grow  to  infinity.  The  achievable  limit  processes  include:  re¬ 
flected  Brownian  motion,  (finite  state)  Markov  modulated  Brownian  motion, 
Ornstein-Uhlenbeck  modulated  fluid,  and  Orstein-Uhlenbeck  modulated  re¬ 
flected  Brownian  motion.  We  describe  each  of  these  limits  and  the  parameter 
scalings  which  give  rise  to  them. 


P.  R.  Kumar 
University  of  Illinois 
Coordinated  Science  Laboratory 

1308  West  Main  Street 
Urbana,  IL  61801 

Scheduling  queueing  networks:  Stability,  performance  analysis 

and  design 

Queueing  networks  are  a  useful  class  of  models  in  many  application  do¬ 
mains,  e.g.,  manufacturing  systems,  communication  networks,  and  computer 
systems.  Control  is  typically  exercised  over  such  systems  by  the  use  of 
scheduling  policies. 

However,  if  one  venturis  outside  a  certain  special  class  of  systems  for 
which  the  steady  state  distribution  has  a  product  form,  very  little  is  known 
concerning  their  performance  or  even  stability.  In  the  first  half  of  talk,  we 
present  new  theoretical  developments  on  stability  analysis  and  performance 
evaluation  for  queueing  networks  and  scheduling  policies.  In  the  second  half. 


we  address  the  problem  of  scheduling  a  class  of  queueing  networks  called  re¬ 
entrant  lines  which  model  semiconductor  manufacturing  plants.  Wc  propose 
a  new  class  of  efficient  scheduling  policies  based  on  smoothing  all  the  flows 
in  the  system. 


Moshe  Zakai 

Electrical  Engineering  Department 
Technion  -  I.  I.  T. 

Haifa  32000,  Israel 

Some  bounds  on  the  filtering  error  in  nonlinear  filtering 

The  first  part  of  the  talk  will  be  devoted  to  a  general  introduction  to 
Wiener,  Kalman-Bucy  and  nonlinear  filtering.  The  main  results  for  the  opti¬ 
mal  filter  and  the  associated  minimal  mean  squared  error  will  be  discussed. 
The  second  part  will  be  devoted  to  the  presentation  of  a  bounding  technique 
for  the  lower  bounding  of  the  filtering  error  and  a  particular  case  will  be 
evaluated  explicitly. 


Rafail  Khasminskii 
Department  of  Mathematics 
Wayne  State  University 
Detroit,  MI  48202 

Some  robustness  problems  in  stability  of  stochastic  differential 

equations. 

The  problems  of  robustness  of  asymptotic  stability,  instability,  Lyapunov 
exponents  and  stability  index  for  linear  and  homogeneous  of  degree  one 
stochastic  differential  equations  with  respect  to  small  nonlinear  perturba¬ 
tions  of  coefficients  are  considered.  Sufficient  conditions  for  the  robustness 
of  stability  index  are  proposed  in  particular. 
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Lennart  Ljung 
Linkoping  University 
Inst.  f.  Systemteknik 
S-581  83  Linkoping 
Sweden 

Tracking  ability  and  accelerated  convergence  in  adaptive 

algorithms 

Basic  stochastic  approximation  has  been  a  great  source  of  inspiration 
for  all  kinds  of  adaptative  and  tracking  algorithms  used  in  many  technical 
applications.  To  understand  and  develop  the  algorithms  it  is  necessary  to 
have  good  insight  into  their  performance  properties.  In  this  presentation  we 
will  overview  approaches  to  performance  analysis,  in  particular  the  ability 
of  different  algorithms  to  track  changing  phenomena.  This  includes  some 
quite  recent  results  with  explicit  expressions  and  bounds  for  the  performance 
measures. 

The  presentation  will  also  cover  some  aspects  of  the  recent  development 
in  accelerated  convergence  (with  a  “second  round  of  averaging”).  The  focus 
is  here  on  whether  the  ability  to  track  changing  properties  is  also  improved 
in  a  similar  way. 


Ioannis  Karatzas 
Department  of  Statistics 

Columbia  University 
New  York,  NY  10027 
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Recent  results  are  presented  on  the  optimality  of  Gittins  index-type  strate¬ 
gies  for  very  general  dynamic  allocation  problems  of  the  “multi-armed  ban¬ 
dit”  form,  in  both  discrete  and  continuous  time.  In  particular,  it  is  shown 
that  no  Markovian  assumptions  are  necessary,  and  that  the  independence 
conditions  on  the  evolution  of  the  different  projects  or  “arms”  can  be  relaxed 
considerably.  (This  is  joint  work  with  Professor  Nicole  El  Karoui.) 
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